Apparatus and method for capturing and viewing images

ABSTRACT

A dual sided viewing panel and a method of capturing and displaying images, is disclosed. The dual sided viewing panel includes a first viewing panel and a second viewing panel. The first and second viewing panels are controllable by a control device to capture an image and display an image. The first and second viewing panels are positioned in an aligned back to back relationship to each other. In a method, a first image is captured by the first viewing panel and a second image is captured by the second viewing panel. The first captured image is displayed on the second viewing panel and the second captured image is displayed on the first viewing panel. The viewing direction of the first viewing panel is opposed to the viewing direction of the second viewing panel.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of prior U.S. patent application Ser.No. 12/186,193 filed Aug. 5, 2008 now U.S. Pat. No. 7,948,547, nowPublication No. US2010/0033613, which is hereby incorporated herein inits entirety.

FIELD OF THE INVENTION

The present invention relates to an image capture and display device.

BACKGROUND OF THE INVENTION

Image capture and display devices are known that are able to capture animage and then display that image on a display panel. These devices maybe generally known as a Display That Sees (DTS). These DTSs may, forexample, simulate a mirror. The DTS captures the image of an object thatis in front of the DTS and then displays the captured image on the DTS.Thus, in effect, the image of the object in front of the DTS is capturedby the DTS and then “mirrored” back on the DTS by displaying thecaptured image on the DTS. However, with a DTS, as opposed to an actualmirror, the image in front of the DTS is electronically captured andthen electronically displayed. This can provide utility since theelectronically captured and displayed image can be processed such thatmodifications can be made to the electronic image. Of course, with amirror, no such electronic modifications are possible.

Whereas DTSs are currently known for capturing and displaying an imagein front of the DTS, the full range of possibilities for utilizing thistechnology has not been realized. Therefore, there is a need for animproved system and method that can more fully utilize the capabilitiesof the DTS technology.

SUMMARY OF THE INVENTION

In an embodiment of an apparatus of the present invention, a dual sidedviewing panel is provided. The dual sided viewing panel includes a firstviewing panel, where the first viewing panel is controllable to capturean image and display an image, and a second viewing panel, where thesecond viewing panel is also controllable to capture an image anddisplay an image. The first and second viewing panels are positioned inan aligned back to back relationship to each other. A control device isprovided for controlling the first and second viewing panels.

In an embodiment of a method of the present invention, a first image iscaptured by the first viewing panel and a second image is captured bythe second viewing panel. The first captured image is displayed on thesecond viewing panel and the second captured image is displayed on thefirst viewing panel. The viewing direction of the first viewing panel isopposed to the viewing direction of the second viewing panel.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates a first embodiment of a viewing panel that may beused in the apparatus and method of the present invention.

FIG. 2 illustrates a second embodiment of a viewing panel that may beused in the apparatus and method of the present invention.

FIG. 3 illustrates a first embodiment of a dual sided viewing panel inaccordance with the principles of the present invention.

FIG. 4 illustrates a second embodiment of a dual sided viewing panel inaccordance with the principles of the present invention.

FIG. 5 illustrates a third embodiment of a dual sided viewing panel inaccordance with the principles of the present invention.

DETAILED DESCRIPTION OF THE INVENTION

FIG. 1 illustrates a first embodiment of a viewing panel that may beused in the apparatus and method of the present invention. Beforedescribing the dual sided viewing panel and the method for capturing anddisplaying images in accordance with the principles of the presentinvention, a viewing panel will first be described.

FIG. 1 illustrates an embodiment of a viewing panel or an image captureand display device 10, which may also be referred to as a Display ThatSees. As can be seen, the DTS 10 is housed in a cabinet 12. Anelectronic motion image camera 14 is utilized to capture the image of asubject 24 that is disposed in front of the DTS. The captured image maybe a still image, e.g., a photograph, or a moving image, e.g., a movieclip. A digital image projector 16 is utilized to project the imagecaptured by camera 14 onto a light valve projection screen 22 which iselectronically switchable between a transparent state and a frostedstate and which optionally includes a touch screen 23. The light valveprojection screen 22 is located on a common optical axis 20 of thecamera 14 and projector 16. The screen 22 allows the electronic camera14 to capture the image of the subject 24 through the projection screenwhen in the transparent state and provides for displaying the capturedimage by the digital image projector 16 when in the frosted state.

The light valve projection screen 22 may comprise, for example, a liquidcrystal film that changes state when an electrical current is applied.In the “power off” state, the material is “frosted” and suitable forrear projection. In the “power on” state, the material is clear andsuitable for the camera to “see” through the material. A light 21 may beprovided to illuminate the subject 24.

Control of the image capture and display device, and digital imageprocessing, is provided by a computer 26, such as a standardmicro-processor or personal computer, to which the output of the motionimage camera 14 and the input to the digital projector 16 are connected.The computer 26 functions as both a controller and an image processingcomputer. It will be understood that a separate controller and digitalimage processing electronics can be provided. A digitally controlleddriver 28 is provided for driving the light valve projection screen 22to switch it back and forth between its transparent and frosted states.

In operation, the computer 26 first switches the light valve projectionscreen 22 to its transparent state by signaling driver 28 to energizethe screen, then captures an image from camera 14, switches the lightvalve projection screen 22 to its frosted state, again via a signal todriver 28 to turn off the screen, making it frosted, and then projectsthe previously captured image onto the light valve screen 22 using thedigital image projector 16. This cycle is then repeated 15 to 30 or morecomplete cycles per second to provide the appearance of a smooth and“flicker free” display. The captured images may be processed by thecomputer 26 prior to display using known image processing techniques.For example, the images may be geometrically distorted as in a fun housemirror. Alternatively, background scenes may be added using known bluescreen techniques, colors may be modified, or pre-stored image elements,such as mustaches, hats, glasses, etc., may be digitally added. Also,articles of clothing may be added to the image of the subject, forexample to show how the subject would appear in the article of clothing,e.g., as a mannequin. The control of these different processingtechniques may be provided by computer 26 and the application of theparticular technique(s) may be directed by either internal inputs, e.g.,the captured image, or by external inputs, e.g., voice or touch input,or input by movement of the subject of the captured image.

Additional features of the image capture and display device 10 of FIG. 1are disclosed in U.S. Pat. No. 7,042,486, issued on May 9, 2006, toManico et al., the entire disclosure of which is incorporated byreference herein.

FIG. 2 illustrates a second embodiment of a viewing panel that may beused in the apparatus and method of the present invention. For ease ofreference, like reference numerals are utilized for the components inFIG. 2 that are common to the components of FIG. 1. As can be seen inFIG. 2, the image capture and display device (DTS) 10 may also be housedin a cabinet 12. An electronic camera 14 and a display panel 15 areprovided. Display panel 15 is electronically switchable between a firststate and a second state. In this embodiment of the DTS, display panel15 may comprise, for example, a matrix of Organic Light Emitting Diodes(OLED) that change state when an electrical current is applied. In the“power off” state (transmissive state), the material is substantiallytransparent and suitable for viewing there through. In the “power on”state, the display panel 15 will display an image for viewing by anindividual (viewer) 24 positioned in front of the display panel 15. Anoptional touch screen 23 may be provided over display panel 15. Thetouch screen 23 can be of the type having an array of infraredtransmitters and detectors arranged around the periphery of the displaypanel 15, or a transparent pressure sensitive panel disposed over thedisplay panel 15. The display panel 15 is located with respect to commonoptical axis 20 for allowing the electronic camera 14 to capture theimage of the subject 24 through the display panel 15 when in thetransparent state and for displaying an image by the digital displaypanel 15 for viewing by the individual (user) 24 along a viewing axis.Similar to the embodiment of FIG. 1, the DTS of FIG. 2 includes acomputer 26 and a digitally controlled driver 28.

The embodiment of FIG. 2 is disclosed in U.S. Patent ApplicationPublication No. US 2005/0024489, published on Feb. 3, 2005, and filed byFredlund et al., the entire disclosure of which is incorporated byreference herein. In addition to the embodiment described above, U.S.Patent Application Publication No. US 2005/0024489 discloses additionalembodiments for a DTS which also can be utilized in the apparatus andmethod of the present invention. For example, display panel 15 may becomprised of a liquid crystal display (LCD) in place of an OLED.

The present invention is not limited to any particular embodiment for aDTS for use in the present invention. Any of a variety of known, orcontemplated, DTSs may be utilized without departing from the spirit andscope of the present invention. All that is required is that the DTS beable to capture an image and display the captured image.

Further, it is provided that the illustrations of the embodiments of theDTSs of FIGS. 1 and 2 are not drawn to scale. For example, the entireDTS may only be a few centimeters in width with the camera and projectorbeing of such miniaturized design that they are able to be disposedwithin the DTS such that the DTS includes a thin cross-section, such asthe cross-section of a pane of glass or a mirror. Thus, the digitalimage capture device and the projection device may be integrally formedin each of the first and second viewing panels such as in U.S. PatentApplication Publication No. 2008/0106628, published on May 8, 2008, andfiled by Cok et al., the entire disclosure of which is incorporated byreference herein. Additionally, the computer and driver can also beminiaturized such that they can be disposed within the DTS, or can evenbe disposed external to the DTS and electronically coupled to the cameraand projector within the DTS. Thus, the present invention is not limitedto any particular physical structure for the components of the DTS.

FIG. 3 illustrates a first embodiment of a dual sided viewing panel 100in accordance with the principles of the present invention. Dual sidedviewing panel 100 includes a first viewing panel 110, or first DTS, andincludes a second viewing panel 120, or second DTS. As discussedpreviously, both the first viewing panel 110 and the second viewingpanel 120 are controllable to both capture an image and display animage. Thus, first viewing panel 110 and second viewing panel 120 caneach be comprised of any of the disclosed embodiments, or contemplatedembodiments, for a DTS.

As can be understood, first viewing panel 110 can be utilized to capturean image that is disposed in front of first viewing panel 110. Thedouble arrow illustrates the viewing directions associated with firstviewing panel 110. Therefore, an object in front of first viewing panel110 (to the left of first viewing panel 110) can be captured by firstviewing panel 110 and the captured image can be displayed on the forwardfacing surface of first viewing panel 110 (the left facing surface offirst viewing panel 110).

Similarly, second viewing panel 120 can capture an image disposed infront of second viewing panel 120 (to the right of second viewing panel120). Second viewing panel 120 is then able to project the capturedimage on the front side of the second viewing panel 120 (the side facingto the right).

As can be seen in FIG. 3, in accordance with the principles of thepresent invention, the first viewing panel 110 and the second viewingpanel 120 are positioned in an aligned back to back relationship to eachother. The aligned position refers to the optical axis for capturing andviewing of first viewing panel 110 being aligned with the optical axisfor capturing and viewing of second viewing panel 120. This alignmentfeature of the present invention will be discussed in further detailbelow. In the embodiment of FIG. 3, the backs of the respective viewingpanels are disposed adjacent to each other such that the display screensof each viewing panel are opposed from each other and faced in oppositedirections. Thus, the display screen of first viewing panel 110 faces tothe left and the display screen of second viewing panel 120 faces to theright. As discussed previously, both the first and second viewing panelsare controllable to capture an image and display an image and a controldevice is included for controlling the first and second viewing panels.

In accordance with the principles of the present invention, placing DTS110 and DTS 120 in a back to back relationship to each other provides afuller range of possibilities for utilizing the DTS technology. With theconfiguration of the present invention, not only can one DTS capture animage in front of the DTS and display that image on the viewing panel ofthat DTS, but additionally, that DTS can provide the captured image tothe second DTS for displaying on the viewing panel of that oppositefacing DTS. In this manner, a viewer that is looking at a DTS on oneside of the DTS can actually “see” an image that is captured on theother side of the DTS by the DTS that is on the opposing side and whichDTS provides the opposing side image to the DTS that the viewer isviewing.

For example, first viewing panel 110 is able to capture an image that isin front of first viewing panel 110. First viewing panel 110 is thenable to not only display that captured image on its display panel, butadditionally, provide that captured image to second viewing panel 120for display on the display panel of the second viewing panel. Secondviewing panel 120 can operate similarly. Thus, as can be understood, acaptured image on one side of the dual sided viewing panel 100 can beprovided to the opposing side of the dual side viewing panel.

This feature of the present invention has numerous useful applications.For example, dual sided viewing panel 100 can be utilized such that itoperates as a window pane. In FIG. 3, a viewer to the left side of dualsided viewing panel 100 can see objects on the right side of dual sidedviewing panel 100 when second viewing panel 120 captures an image on theright side and provides it to first viewing panel 110 for display on theleft side. In effect, the viewer to the left side of dual sided viewingpanel 100 is peering “through” the dual sided viewing panel 100 to seewhat is on the opposing side of dual sided viewing panel 100. Thisprovides particular utility when considering that the functionality of awindow can be provided, however, drawbacks with respect to utilizing awindow pane are avoided, e.g., breakability of the window, minimalphysical security, privacy, etc.

Further in accordance with the principles of the present invention, notonly can the captured image from one side of the dual sided viewingpanel 100 be projected on the opposing side of the dual sided viewingpanel, but additionally, that projected image can be manipulated by theelectronics of the dual sided viewing panel such that the image that isdisplayed to the viewer can be controlled depending upon therequirements of any particular application with which the dual sidedviewing panel is utilized. For example, additional scenes can beprovided on the projected image, a false image can be provided forsecurity purposes, and the image can be manipulated to change itscharacteristics.

FIG. 4 and FIG. 5 illustrate further embodiments of the dual sidedviewing panel of the present invention. In FIG. 4, the dual sidedviewing panel 200 again includes first viewing panel 210 and secondviewing panel 220, which operate as discussed previously. However, inthis embodiment, outer protective panels 215 and 225 are provided on theoutward facing surfaces of the first and second viewing panels. Theseprotective panels 215 and 225 are generally transparent such that imagescan be both captured and displayed on the viewing panels, however, theprotective panels are of sufficient strength to protect the viewingpanels from, e.g., physical damage, pressure forces, environmentaleffects, etc. Additionally, the panels may provide for additional oralternative effects, e.g., be shaded to provide coloring effects,include static images, etc.

Similarly, in the embodiment of FIG. 5, an intermediate panel 330 isprovided between first viewing panel 310 and second viewing panel 320.This intermediate panel 330 can be provided for a variety of purposesthat are not connected to image capture or display such as security,thermal insulation, sound insulation, radiation barrier or otherprotective purposes, such as, for example, providing a non-penetrablebarrier between the two viewing panels or simply a space that is notmeant to be seen. In an application where the dual sided viewing panel300 is being utilized as a store front window, for example, theintermediate panel can provide for additional physical security over andabove what a normal window pane could provide. Additional applicationssuch as for a U.S. Defense Department-related “window” or a lawenforcement “window” can be contemplated for this embodiment. However,even with this enhanced security feature, as described previously, thedual sided viewing panel 300 could still provide the same functionalityof a window pane such that a person on the left side of the dual sidedviewing panel 300 could see what was occurring on the right side of thedual sided viewing panel 300 and, similarly, a viewer on the right sideof the dual sided viewing panel 300 could see what was occurring on theleft side of the dual sided viewing panel 300.

As can be understood, and as discussed above in the context of theseveral examples, the dual sided viewing panel can provide manypossibilities for further utilizing the DTS technology. As discussed,the dual sided viewing panel can be utilized as a window replacement.The “window” can be utilized for any of a variety of purposes includingsecurity, advertising, entertainment, and decorative applications, whichwill be further briefly discussed below.

Further with respect to security, the image displayed on the DTS can bean image that is altered from the image that is captured on the opposingside of the DTS or the displayed image can be a false image. In thismanner, the viewer thinks that he/she is viewing what is occurring onthe opposing side of the “window”, however, the viewer is actually onlyviewing a false or manipulated image from that which is actuallyoccurring on the opposing side of the dual sided viewing panel.

The dual sided viewing panel of the present invention can also haveutility in an advertising context. For example, if a viewer is lookinginto a store front “window” that is actually a dual sided viewing panel,the dual sided viewing panel can additionally capture the image of theviewer and manipulate the image such that it is projected back to theviewer in an altered state. The altered state, for example, could be ause of the viewer's image as a mannequin where the viewer's image hasbeen manipulated to display the image with an object that is alsodisplayed in the “store front window”. Thus, a “virtual mannequin” couldbe displayed where apparel for sale, as displayed in the store frontwindow, could be projected onto the image of the viewer, i.e., thevirtual mannequin. This virtual mannequin could be displayed in realtime. Additionally in this context, a viewer on the opposing side of thedual sided viewing panel, e.g., a shop owner within the “store”, couldview the “window” shopper.

In another contemplated application, the dual sided viewing panel can beused as a substitute for a wall(s) that is generally used to enclose,for example, an office cubicle. Thus, a wall would still be in existenceto provide privacy and security to the occupant, however, the occupantwould have the more pleasant experience of thinking that either no wallwhatsoever was in place or that they are looking out of a full-panelwindow, such as in a corner office, instead of looking at a wall. Thiseffect is achieved since, as discussed previously, images from theopposing side of the dual sided viewing panel can be displayed to theoccupant on the internal side of the dual sided viewing panel. Or,alternately, the office cubicle can be located between the first viewingpanel 310 and the second viewing panel 320 in the intermediate panel 330such that viewers of the first viewing panel 310 or viewers of thesecond viewing panel 320 would appear to see through the office cubicle.Similarly, blank entertainment screens in a home can be covered by adual sided viewing panel such that the area of the screen now appears tobe a window or may include any image that can be projected on the dualsided viewing panel.

The feature of the invention where both the first viewing panel and thesecond viewing panel are positioned in optical alignment in a back toback relationship provides for further utility. Thus, an image on oneside of the dual sided viewing panel that is captured and displayed onthe opposing side of the dual sided panel appears on axis with respectto the frame of reference of the viewer since the optical axes of bothviewing panels are aligned. If the axes were not aligned, a capturedimage from one side of the dual sided viewing panel that is displayed onthe opposing side of the dual sided viewing panel would not appear to bea true image that is viewed by the viewer “through” the dual sidedpanel.

This optical alignment also provides for greater interactivity betweenimages captured on one side of the dual sided viewing panel anddisplayed on the opposing side of the dual sided viewing panel. Forexample, by capturing an on-axis image from one side of a viewing paneland displaying it on-axis on an opposing side of the dual side viewingpanel, and vise versa, viewers on both sides of the dual sided viewingpanel can sense that they are physically interacting with the activityon the opposing side. For example, viewers on opposing sides of the dualsided viewing panel can appear to be interacting with each other, suchas in playing tennis. An image of a viewer striking the ball on one sideis displayed on-axis to the viewer on the other side. The viewer on theother side then can strike the ball of the displayed image. This imageis then captured and displayed on the opposing side of the dual sidedviewing panel for similar striking by the opposing viewer.

Additionally in this manner, what occurs on one side of the dual sidedviewing panel may control what occurs on the other side of the dualsided viewing panel. For example, for a particular image that iscaptured on one side of the viewing panel, this captured image may beutilized to control which image is captured or displayed on the opposingside. Likewise, for a particular image that is displayed on one side ofthe dual sided viewing panel, this displayed image may be utilized tocontrol which image is captured or displayed on the opposing side.Similarly, the first and second viewing panels may include sound andtouch sensors that may also be utilized to control which images arecaptured and displayed on either of the sides of the dual sided viewingpanel. Additionally, the sound sensor may also include a sound producingdevice to add sound to the presentation of the panels to enhance thedisplay of images on the viewing panels. Thus, with respect to thecontrol of the viewing panels, because images are captured anddisplayed, and may be manipulated, many possibilities exist for thecontrol of which particular images are captured and displayed and howthis control may be implemented, e.g., touch, sound, image capture,image display, etc. These inputs may be provided to the control devicewhich, responsive to the inputs, captures and/or displays images inaccordance with processing instructions.

Whereas the dual sided viewing panel has been discussed primarily in thecontext of large panels, e.g., windows, display screens, and walls, thepresent invention is not limited to only being used in such contexts.The present invention can be utilized in any context where it isdesirable to capture an image on one side of the dual sided viewingpanel and display the captured image on an opposing side of the dualsided viewing panel. Additionally, the present invention can be utilizedin any context where control of the captured images and projected imagesis desirable to achieve additional functionality. For example, the dualsided viewing panel can be utilized as a Graphical User Interface (GUI)where the manipulation of the interface by a user causes images to becaptured and displayed. Further with the use as a GUI, the cameras thatare used to capture images can also be used to detect, for example,hand/finger positions, facial expressions, lip movements, body positionsand movements, etc., and the displays can provide feedback via virtualobjects such as a pointer or cursor that can be directed by the userwith the GUI. Thus, with use as a GUI, the user is able to provide inputand control while the system can provide appropriate feedback, e.g.,image capture/detect and image display, based upon the particularrequirements of the application of the GUI.

Additionally, the dual sided viewing panel can be incorporated into acell phone application or any hand held viewing device where it isdesirable to capture images from one side of the device and display themon an opposing side of the device. The present invention is not limitedto any context in which the dual sided viewing panel can beincorporated. The examples discussed herein for the uses of the dualsided viewing panel are only but a few of the many applications intowhich the present invention may be incorporated. The present inventioncan be utilized in any of a multiplicity of applications that can becontemplated.

The invention has been described in detail with particular reference tocertain preferred embodiments thereof, but it will be understood thatvariations and modifications can be effected within the spirit and scopeof the invention.

PARTS LIST

-   10 image capture and display device-   12 cabinet-   14 electronic motion image camera-   15 display panel-   16 digital image projector-   20 common optical axis-   21 light-   22 light valve projection screen-   23 touch screen-   24 subject-   26 computer-   28 digitally controlled driver-   100 dual sided viewing panel-   110 first viewing panel-   120 second viewing panel-   200 dual sided viewing panel-   210 first viewing panel-   215 outer protective panel-   220 second viewing panel-   225 outer protective panel-   300 dual sided viewing panel-   310 first viewing panel-   320 second viewing panel-   330 intermediate panel

1. A method for capturing and displaying images, comprising the stepsof: optically aligning and integrating a first and a second imagecapture and display device by providing the first and second imagecapture and display devices-disposed in an aligned back to backrelationship to each other to provide a common optical axis and whereina first viewing direction of the first image capture and display deviceis opposed to a second viewing direction of the second image capture anddisplay device; capturing a first image by the first image capture anddisplay device; capturing a second image by the second image capture anddisplay device wherein the first or second images or both are adapted tobe displayed on the first or second display devices; altering either thefirst of second images or both to provide one or more altered images;displaying an altered first captured image on either the first or secondimage capture and display device; and displaying the second capturedimage or an altered second captured image on the other image capture anddisplay device.
 2. The method of claim 1 wherein the altered image(s)includes objects being offered in an advertising context.
 3. The methodof claim 1 wherein the altered image(s) includes interactive objects. 4.The method of claim 3 wherein the altered image(s) includes a graphicaluser interface.
 5. The method of claim 1 wherein the altered image(s)includes false images.
 6. A method for providing an image and capturedevice that appears to be a window comprising: optically aligning andintegrating first and second image capture and display devices in a backto back relationship to each other to provide a common optical axis andwherein a first viewing direction of the first image capture and displaydevice is opposed to a second viewing direction of the second imagecapture and display device; capturing a first image by the first imagecapture and display device; capturing a second image by the second imagecapture and display device; altering the first captured image to providean altered image; displaying the altered image on the second imagecapture and display device; and displaying the second captured image onthe first image capture and display device.
 7. The method of claim 6wherein the altered image includes objects being offered in anadvertising context.
 8. The method of claim 6 wherein the altered imageincludes interactive objects.
 9. The method of claim 8 wherein thealtered image includes a graphical user interface.
 10. The method ofclaim 6 wherein the altered image includes false images.